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SECTION  I 
INTRODUCTION 

At  the  twelfth  meeting  of  the  Photographic  Reconnaissance  Equipment 
Advisory  Group  (PREAG)  in  September  1973,  MSgt.  Tony  Pollizzi  presented 
a paper  on  the  method  of  determining  photographic  system  resolution  by 
edge  gradient  measurements.  The  exploration  of  this  technique  was 
encouraged  by  the  need  for  a simple  method  to  evaluate  imagery  at  the 
field  level.  His  criteria  included  a fairly  accurate  resolution  measure- 
ment having  day-to-day  consistency,  requiring  a minimum  amount  of  time 
to  perform  the  actual  measurements  and  resolution  determinations,  and 
providing  the  capability  to  obtain  ground  resolution  readings  without 
scheduling  special  flights  over  a bar  target  range. 

Prototype  microscopes  have  been  manufactured  by  Gaertner  Scientific 
Corporation  that  provide  edge  gradient  imagery  analysis.  The  device 
essentially  consists  of  a measuring  microscope  with  a range  of  magnifi- 
cation of  40X-100X  and  a 1951  USAF  target  mounted  on  a rotatable  reticle 
located  in  the  barrel  of  the  microscope. 

At  this  PREAG  meeting,  it  was  recommended  that  Air  Force  Avionics 
Laboratory  (AFAL)  purchase  one  of  these  microscopes  to  evaluate  this 
method.  Subsequently,  this  became  an  action  item  under  the  Sentinel 
Sigma  program  and  a measuring  microscope  similarly  equipped  was 
purchased  from  Gaertner  Scientific  Corporation  by  AFAL.  The  unit 
mounted  on  a Richard's  light  table  is  shown  in  Figure  1.  This  arrange- 
ment with  the  microscope  cantilevered  from  the  moveable  slide  was 
established  to  allow  a simple  set  up  where  the  unit  could  be  interchanged 
easily  with  the  Bausch  and  Lomb  microscope.  However,  the  arrangement 
was  not  rigid  causing  focus  shift  problems  when  slight  force  was  applied 
to  the  set  up.  This  shifting  and  the  absence  of  a fine  focus  adjustment 
caused  considerable  problems.  However,  with  care  and  patience  in  reading 
the  targets,  this  problem  was  reduced.  Future  implementations  should 
consider  a more  stable  and  rigid  mounting  arrangement  and  a fine  focus 
adjustment  as  requirements  for  any  anticipated  deployment. 
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Efficient  operation  of  the  unit  requires  a reasonable  degree  of  training. 
During  the  AFAL  test,  nine  different  readers  were  used  with  experience 
ranging  from  very  little  to  extensive.  One  reader  spent  more  than  40 
hours  training  in  the  use  of  this  technique  investigating  various  methods 
of  reading  targets.  All  other  observers  had  a nominal  hour  indoctrination 
before  reading  targets.  The  results  of  the  nine  including  the  one 
especially  trained  are  reported  herein. 
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SECTION  II 
TEST  DISCUSSION 

The  basic  concept  in  using  this  device  is  to  match  the  estimated 
width  of  a target  edge  with  a bar  or  space  on  the  three  bar  target 
reticle  located  in  the  microscope.  The  target  element  is  noted  and  the 
resolution  is  determined  from  a table  supplied  with  the  microscope. 

Readers  differed  considerably  on  what  they  preferred  to  match  in  the 
target  reticle;  a space,  a bar,  or  a space-bar  combination.  The  expert 
reader  preferred  to  match  bars.  In  the  event,  both  a bar  and  space  are 
matched  to  the  edge  the  resulting  resolution  value  must  be  doubled  to 
yield  the  correct  number. 

For  the  test,  84  medium  contrast  and  6 low  contrast  targets  were 
measured.  Figure  2 shows  the  layout  of  seven  of  the  medium  contrast 
targets.  The  six  low  contrast  targets  were  similar  except  that  there 
was  only  one  target  per  frame.  The  expert  observer  read  all  90  targets; 
however,  the  other  eight  observers  read  only  1 2 targets  selected  from  the 
90.  These  targets  were  selected  to  give  three  approximate  ranges  of 
resolution:  four  high  resolution  targets  (above  100  line  pair/mm),  four 

medium  resolution  targets  (75  to  100  line  pair/mm),  and  four  low  reso- 
lution targets  (less  than  75  line  pair/mm),  with  each  range  having  two 
medium  (5.6:1)  and  two  low  (1.4:1)  contrast  targets.  The  resolution  data 
for  the  nine  observers  reading  the  targets  using  the  usual  three  bar 
method  and  the  edge  gradient  method  are  listed  in  Table  1.  Shown  are 
each  individual's  readings  for  both  the  tangential  and  the  radial  direc- 
tions, the  average  of  the  readers,  and  the  standard  deviation  among  the 
readers  for  every  target.  In  calculating  these  averages  and  deviations, 
any  observation  that  deviated  by  more  than  50%  from  any  other  reading  in 
the  group  was  eliminated. 

A summary  of  the  test  results  is  shown  in  Table  2.  There  the  group 
averages,  the  standard  deviation,  and  the  three  bar  element  differences 
corresponding  to  the  standard  deviations  are  presented.  The  nine  observers 
deviated  less  than  two  resolution  target  elements  using  the  standard  three 
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Figure  2.  Layout,  of  the  Targets 
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RESOLUTION  READINGS  FOR  ALL  NINE  OBSERVERS  (LP/MM) 


SIGMA  59.34  25.26  18.34  15. II  SIGMA  22.01  36.48 


TABLE  1 (Concluded) 
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bar  reading  method  and  the  results  were  independent  of  contrast  and 
resolution  value.  Using  the  edge  method,  they  deviated  less  than  three 
elements  for  resolutions  to  100  line  pair/mm  and  the  results  again  were 
independent  of  contrast.  In  the  high  resolution  area  (above  100  lines 
pair/mm),  the  edge  gradient  method  had  maximum  deviations  equivalent  to 
five  elements.  This  is  a resolution  difference  of  four  elements  between 
the  three  bar  method  and  the  edge  method  for  the  worst  case.  From  this 
it  appears  that  the  edge  method  gives  reasonable  correlation  for  targets 
with  resolution  values  less  than  100  line  pair/mm  when  comparing  the 
average  values  by  both  methods. 


The  performance  of  the  individual  observers  was  investigated  to 
determine  if  a particular  reader's  data  were  biased  or  incorrect. 

Table  3 lists  the  experience  of  each  observer  and  the  number  and 
percentages  of  times  that  he  recorded  either  the  highest  or  the  lowest 
reading  of  the  group  on  a particular  target.  Ties  counted  for  all 
observers.  From  this  brief  look,  no  pattern  is  evident  that  substantiates 
inconsistencies  of  any  individual's  data. 


The  results  of  our  expert  reader  over  the  total  90  targets  are 
displayed  in  Table  4.  The  results  showed  good  correlation  between  edge 
gradient  three  bar  target  results  in  most  cases.  One  set  of  low  reso- 
lution color  film  specimens  was  also  examined  by  our  expert  reader.  The 
results  comparing  the  two  methods  were  extremely  close  as  shown  in  Table 
5.  The  corresponding  standard  deviations  for  the  color  imagery  were 
3.97  and  4.58  for  edge  versus  4.24  and  4.32  for  the  three  bar  method. 

This  is  less  than  one  resolution  target  element  error  between  the  average 
readings. 
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READER  H 

TABLE  3 

OBSERVER  EVALUATION 

EDGE  METHOD 

# TIMES  H IGH/%  » TIMES  LOW/* 

READER  EXPERIENCE 

1 

2-6.5 

0-0 

6 yrs 

' 

2 
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12  yrs 

[ 3 
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12  yrs 
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1 5 

1-3.  2 
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' 6 
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5-1 S. 5 
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j 7 

12- 33.7 

0-0 

20  yrs 

8 
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3-11.1 
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9 

0-0 

7-25.9 

0 yrs 

3 BAR  METHOD 

1 
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2 • 
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7 
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20  y > s 

8 

1-2.6 

5-12.2 

0 yrs 

9 

4-10. 3 

5-12.2 

0 yrs 

EXPERT  OBSERVER  REAOINGS  (IP/mn) 


EDGE  METHOD  THREE-BAR  METHOD  EDGE  METHOD  THREE-BAR  METHOD 


EKTACHROME  IMAGERY  RESOLUTION  READING  (LP/mm) 
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SECTION  III 

CONCLUSIONS  AND  RECOMMENDATIONS 

One  objection  everyone  made  about  the  instrument  was  that  the  three 
bar  targets  used  on  the  microscope  reticle  masked  the  photographic  edges 
to  be  measured.  It  is  recommended  that  another  reticle  be  incorporated 
in  the  device  instead  of  the  three  bar  targets.  For  example,  a crosshair 
reticle  with  hatch  markings  corresponding  to  direct  resolution  values 
could  be  incorporated  in  the  device.  With  this  method,  one  side  of  the 
estimated  edge  would  be  aligned  and  parallel  and  coinciding  with  one 
axis  of  the  crosshair.  The  resolution  is  read  at  the  point  on  the 
reticle  scale  where  the  other  estimated  side  of  the  edge  crosses  the 
other  axis. 

The  results  are  generally  encouraging,  indicating  that  photographic 
system  resolution  measurements  using  the  edge  gradient  technique  tend 
to  satisfy  MSgt.  Pollizzi's  criteria.  The  measuring  microscope  edge 
gradient  method  yields  reasonably  accurate  results  particularily  when 
used  on  B&W  film  targets  with  resolution  of  less  than  100  line  pair/mm, 
and  for  color  film  in  the  30-50  lp/mm  range.  This  range  was  the  only 
one  tested  using  color  film. 

Improvements  in  the  system  such  as  changing  the  edge  matching  recticle, 
the  installation  of  a fine  focus  along  with  a rigid  mount,  an  eye  piece 
to  eliminate  head  motion,  and  an  increased  amount  of  personnel  training 
should  provide  the  field  user  a capability  to  determine  the  approximate 
resolution  of  operation  imagery. 
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